UK Patent Application ,«,GB <i„2355377 <,„ A 

(43) Date f A Publfcation 18.04.2001 



I01 \ 

(Zl| 


Appiicaiion no sfsiuc^iwu.v 


(51) 


INT CL' 






G06T3/40 


IZZ) 


LlaTc OT niiny l ■•1U»1«V99 








(52) 


UK CL (Edition S ) 






H4TT113T119T128 


f71) 


Applicant(s) 








CnC Qnto-Elftetfonics Com 


|5>DJ 


Documents Cited 








tr W> InnifSf Ait tr U/Kfa29 #Vc ¥¥W 5fD/ HKpOU m • 




No 11 Li Hsin Rosft Science-Based Industrial Park, 




wo 90/16034 A1 US 5832142 A US 5054100 A 




Hsinchu, Taiwan 










(58) 


Field of Search 


(72) 


Inventor(s) 




UK CL (Edition R ) H4F FESK FQXE , H4T TCGIC 




Chao-WenlJu 




INT CL^ G06T 3/40 




Ching-shang U . 




Online: Wn, EPODOC, JAPIO 




Ray-hamoSiaia 






(74) 


Agent and/br Address for Service 








Boult Wade Tannant 








Verulam Gaidans» 70 Gff»/8 Irni Road, ijondon. 








WCIX 88^ Unitad Idngdom 







(54) AbstractTide 

DIgitalinuige scaling with amomatic image quality acQustment 

(57) A digital Image scaling device with automatic image quality adjustment is provided for converting the 
resolution and frame rate of digital input image data into different resolution and frame rate. The digital image . 
scaling device includes a memory unit for temporary storing the frame data of the digital Input image data; a 
memory access control unit for storing the digital input image data into the memory unit and for reading th 
digital input image data therefrom; a plurality of interpolationfunctions for providing various interpolation 
effects in response to different Image quality requests; an interpolation controller for reading a plurality of . 
pixels from the memory unit as referential pixels and for generating digital output image data according to an 
interpolation function selected automatically from a plurality of interpolation functions using a function 
sel cting procedure..Since the digital image scaling device of the present invention generates new 
interpolated pixels using different interpolation functions automatically, the image qualities can be improved 
arid the problems of blurring or bibcicing effects can be resolved. 
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2355377 

DIGITAL IMAGE SCALING DEVICE WITH AUTOMATIC IMAGE V 

QUALITY ADJUSTMENT 

BACKGROUND OF THE INVENTION 

A. Field of thie Invention 

S . . The present invention relates to a digital image scaling device with automatically 
adjusting image quality. The scaling device comprises a plurality sets of interpolation 
functions and is capable of automatically selecting a proper interpolation function therefrom. 

B. Description of the Prior Alt 

A digital display device; such as Liquid Crystal Device (LCD), Digital Micro'^mirror 

10 Device (DMD), : plasma display, is necessary to convert the resolution and frame rate of 
original image source, if its resolution or image frame rate is different from the original 
resolution or frame rate. Take a multi-media LCD monitor for an example. The monitor can 
receive and display original image sources of various resolutions and frame rates, such as the 
output signals of the computer video cards, including VGA@60, SVGA@75, XGA@85, and 

15 SXGA@60, NTSC, PAL, and SECAME signals. The resolution and frame rate converter 
scales up or scales dovsm the resolution of the original image source and converts the frame 
rates to display the . images on the digital display device. There are already various IC 
devices embodied with such functions in the market. They are provided by manufacturers, 
such as Genesis, Paradise^ Pixelworks, MXIC, and Arithmbs. These IC devices are provided 

20 with programmable proportion scaling factors for scaling up or scaling down the resolutions 
of the original image source and cbnverting the frame rates. Such IC devices play a crucial 
role in the digital display devices. 

Image scaling up or scaling down means to increase or decrease the resolution of the 
image. In other words, it is an interpolation operation performed on the image. For scaling 

25 up an image, it needs to interpolate new pixels to increase its resolution. These new 
interpolated pixels are inter-related with their neighboring original pixels. The distance can 

1 . 
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be the weighting factor of interpolation and defined as interpolation functions. The new 
interpolated pixels can be computed by a convolution computation based oii the interpolation 
function and the gray level of original pixels. Moreover, based on different interpolation 
function applied, different image qualities can be obtained. 
S In the references relating to digital image processing, various interpolation functions^ 

and the relationships between the interpolation errors and the resolution loss of the frequency 
spectrum for each of the interpolation functions have already been disclosed. Different 
interpolation functions will cause different interpolation errors and resolution loss and thus 
generate different image qualities. In general, a first order bilinear interpolatiori function has 

1 0 been considered as one that can provide a more reasonable trade-off betweeii the interpolation 
errors and the resolution loss and then generate better results for processing nature image: 
However, for graphics or text font images, the first order bilinear interpolation function will 
cause the image to be blurred. In that case, nonlinear interpolation functions may be applied 
to enhance the picture qualities of graphics or text font iniages. 

15 However, if a scaling device only employs a single interpolation function for adjusting 

the resolutions, it cannot be applied to various image types, such as nature linage, text font 
image or graphic. So, after the resolution of the image has been incr-^ised, especially when 
the proportion factors are larger, the mature image will be generated with bett^ effects if a 
first order bilinear interpolation function is applied. On the other hand, the image of text 

20 font image or graphic will be blurred and difficult to see. In contrast, if processed with other 
interpolation functions, such as a second order non-linear interpolation functions, the text font 
image or graphic will have better effects for edge-enhancement, but blocking effects will be 
generated on the nature images. 

SUMMARY OF THE INVENTION 

25 Accordingly, it is an object of the present invention to provide a digital image scaling 
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device which is capable of selecting. a corresponding interpolation function from a plurality . 
sets of different int rpolation functions according to the analysis of the original image pixels 
performed by a function selecting procedure to adjust the imagie quality and resolve the 
blurring phenomena. 

The digital image scaling device of the present invention can automatically adjust the 
image qualities by converting digital input image into digital output image of different 
resolution and frame rate. The scaling device of the present invention includes a memory 
unit for temporary storing the frame data of the digital input image; a memory access control 
unit for controlling the writing of digital input image into the memory unit, and the reading of 
the digital input image data therefrom; a plurality sets of interpolationfiinctions for providing 
various interpolation effects in response to different image quality requests; an interpolation 
controller for reading a plurality of pbcek firom the memory unit as referential pixels and for 
generating digital output image data according to the gray level of the interpolation pixels 
which can be computed by an interpolation function selected automatically from a plurality 
sets of interpolation fimctions using a function selecting procedure and based on the gray 
level of the referential pixels. 

The digital image scaling device with automatic image quality adjustment includes three 
sets of interpolation function, and each establishes a correspondent look-up table. The three 
sets of interpolation function include a sharp function, a medium function and a sofl function. 
If the difference of gray level between the referential pixels is larger than a High Threshold, 
then scaling device selects the sharp function as its interpolation function. If the difference 
is between the High Threshold and a Low Threshold, then the scaling device selects the 
medium function as its interpolation function. Otherwise, the scaling device selects the soft 
function as its interpolation function. Accordingly, the present invention can automatically 
select a proper interpolation function according to the distribution of the gray level of the 
original image. Consequently, the blurring or blocking effects of the image can be 



successfully resolvied. 

BRIEF DESCRDPTiON OF THE DRAWINGS 

These and other objects and advantages of the present invention wiji beconie apparent 
by reference to the following description and accompanying drawings wherein: 
S FIG. 1 is a systmi block diagram showing the digital infuige scaliog device with 

automatic image quality adjustment according to the preferred embodixxiMtt of the present 
invention. 

FIG. 2 is a diagram showing the curvatures of the three interpolation functions, 
FIG. 3 is a block diagram showing the vertical interpolation conirpUer of the system 
10 block diagrauii as shown in ITG 

FIG. 4 is a data control flowchart of the vertical interpolation controller as shown in 

' FIG i 

FIG. 5 is fLinctional block diagram of the horizontal interpolaUoh coAti:plW of the 
* system block diagram as ishown in HG. 1. 
15 EIG^ 6 is a control flow chart showing the data control flow of ^ horizontal 

interpolation controUer as shown iri 

FIG. 7 is a look-up table for a sharp function for showing m example of the 
interpolation fiinction table ac<X)r^^ 

FIG. 8 is a schematic diagram showing an example for illustrating the interpolation 
20 sequence according to a preferred embodirhent of the p 

FIG. 9 is an interpolation flowchart for each frame according to the pFesentinvent ion. 
FIG. 10 is a sj^tem diagrani showing the digital image scaling dieviGe according to 
another preferred embodiment of the present invention. 

FIG. 1 1 is a block diagram showing the two dimension interpolation controller as 
25 shown in FIG. 10. 
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FIG. 1 2 is a block diagram showing the 2-D interpolation kernel. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIIVf ENTS 

A preferred embodiment of the invention is described below. This embodiment is 
merely exemplary. Those skilled in the art will appreciate that changes can be made to the 
S disclosed embodiment without departing from the spirit and scope of the invention. * 

Referring to FIG. 1, it shows the system block diagram of the digital image scaling 
device with automatic image quality adjustment according to a preferred embodiment of the 
present invention. The scaling device includes a frame buffer 4 for storing the frame data of 
the original image data, a SDRAM write controller 2 for writing original image data into the 
1 0 frame buffer 4, line buffers 6 and 7, a SDRAM access controller 8 for controlling the reading 
data from the frame buffer 4 and storing the data into the line buffers 6 and 7, a vertical 
interpolation controller 12, a horizontal interpolation controller 14, a line buffer read/write 
controller 10, a interpolation function look-up tables 16 with three interpolationfunctions, and 
a dipt buffer 1 8. In addition, the output of the horizontal interpolation controller 14 of the 
IS scaling device is connected to a display device 20. In the following, the functions of each 
block will be explained in detail. 

The frame buffer 4 is functioning as a buffer between the original image data and output 
data. Since the frame rate of the original image and that of the display device may be 
different, so the franie buffer 4 must be embodied with the functions of frame rate 
20 conversions. To achieve such a purpose, usually a frame buffer 4 is applied between the 
input. terminal and the output terminal. The embodiment of the present invention is using 
SDRAM as the frame buffer 4. It is known to those skilled in the art that other types of 
memories can also be applied. 

The SDRAN^I write controller 2 is for controlling the operation of writing the original 
25 image data into the frame buffer 4. The original image data (input signal source) has 
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multiple formats for the user to choose, such as digitalization of output data of a computer 
video card and video frequency signal data. After the input signal source is determined, the 
SDRAM write controller 2 can generate a corresponding control timing signals for writing the 
frame data into the frame buffer 4. 
5 The line buffers 6 and 7 are for temporary storing two lines of original image d^a. 

The line buffer 6 and 7 are for storing the upper and lower line of the image data, respectively. 
The data in the line buffers 6 and 7 are provided for a vertical interpolation controller 12 as 
the referential pixels when perfonning vertical interpolation. 

The SDRAM access controller 8 is functioning as an iiiterface for accessing the data 
iO from frame buffer 4 (SDRAM). The image frame access request signal of the SDRAM 
access controller 8 is generated by the line buffer read/write controller 10 described 
afterwards. 

The line buffer read/write controller 10 is for controlling the data access of the line 
buffers 6 and 7, and for providing a image frame access request signal to Uie SPRAM abeess 
15 controller 8. The new line data request signal is provided by the vertical interpolation 
controller 12 described afterwards. 

The vertical interpolation controller 12 is for interpolating new pixels in the vertical 
direction. The vertical interpolation controller 12 reads the data in the line buffer arrays 6, 7 
and computes the new pixels, and then sends the new pixels to the dot buffer 18 or the 
20 horizontal interpolation controller 14. The detailed operations of the vertical interpolation 
controller 1 2 will be explained later. 

The dot buffer 18 is for temporarily storing the data from the vertical interpolation 
controller 1 2 or from the horizontal interpolation controller 14. 

The horizontal interpolation controller 14 is for generating new pixels in the horizontal 
25 direction. The horizontal interpolation controller 14 reads the pixels generated by the 
vertical interpolation controller 12 and the pixel stored in the dot buffer 18, and then generates 
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th new pixels and sends these pixels to the display device 20. The detailed operations of . t 
the horizontal interpolation controller 14 will be explained thereafter 

The interpolation function look-up table 1 6 stores the data computed according to three 
different interpolation functions, for example sharp function, medium function, and soft 
5 function. An example of the computation results according to the interpolation ftinctions is 
shown in FIG. 2. The interpolation function look-up table 16 can provide correspondent 
y function values to compute new interpolated pixels by looking up a table for the vertical 
interpolation controller 12 and the horizontal interpolation controller 14. The advantages for 
looking up a table is that the designs of the circuitry will be much simpler and the design of 
10 the interpolation functions more flexible. Of course, the number of interpolation functions 
for the look-up table 16 is not limited to three. It can be determined upon practical . 
application. 

As illustrated in FIG. 7, it shows an example of the interpolation function look-up table 
16 according to the present invention. Each interpolation function is divided into 32 
15 segments and each segments stores a function value with an 8-bits data. The interpolation 
function look-up table 16 stores each correspondent segment value and its function value. 
And each interpolation function look-up table can be established using a program. 

Then, refer to FIG. 3 and FIG. 4 for illustrating the operations of the vertical 
interpolation controller 12 according to the present invention. As illustrated in Fig 3, the 
20 vertical interpolation controller 12 reads the upper pixel UP and down pixel DP from the line 
buffers 6 and 7 each time. In addition to sending the pixels to the vertical interpolation 
kernel SI 23, it also computes the absolute gray differences » Y between the UP and DP 
according to the formula (1) of step S121, and then sneds Y to the function selecting 
procedure S 122. 
25 Y = Abs(UP-DP) 0) 

The function selecting procedure S122 determines which interpolation function table to 
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be selected according to Y for the new pixel to be interpolated. The determination procedure 
is as foil ws: if Y is larger than the High-Threshold HT. then select the sharp function. If Y 
is smaller than the Low-Threshold LT, then select the soft function. If Y is between the 
High-Threshold and the Low-Threshold, then select the medium function. After that, 
S provide the selected interpolation function to the vertical interpolation kernel SI 23 for 
computing the new pixels. 

In generaU the values for the HT and LT are not fixed because they can be adjusted by 
the users depending on the demanded image qualities. However, for ims^es with 256 gray 
levels, if the HT and LT are set to be 128 and 80, respectively, then it can generate imag^ of 
10 better qualities. For images of different gray levels, different threshold values should be 
applied. 

FIG. 4 shovys the operations of the vertical interpolation kernel S 1 23. As illustrated in 
FIG. 4, the parameteis required by the vertica.1 interpolation kernel SI 23 are New Row Ratio 
NRR, Vertical Scaling Factor VSF. Up Pfacel UP and Down Pixel DP. the initial value of 
1 5 NRR is set as 0 at the time when a new image frame is generated. The VSF is determined 
according to the Input Height IH of the original image and the Display Height DH, and 
adjusted as 1 6 bits data according to the forrnula (2): 
VSF = (IH«11/DH) (2), 
wherein '*<<" means left-shifting 1 1 bits of the IH. The purpose of left-shifting IH is 
20 to enlarge the value of VSF for the convenience of computation. The number of left-shifted 
bits is not restricted to H . It depends on the design of the entire circuitry. 

Then, refer to FIG 4 for illustrating the operations of the vertical interpolation kernel 

S123. 

Step S 1 24: Compute Row Ratio RR, that is, RR=VSF+NRR. 
25 Step SI 25: Compute the MSB of row ratio, that is, rvlR=(RR&OXI800) »\\, The 

number of right-shifted bits is the same as that of the left-shift«d bits of the VSF. 
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Step S 1 26: Compare if the value of MR is larger or equal to I . If the value is larger or 
equal to 1 . it indicates that.the new pixel to be interpolated exceed themargins of the rows in 
line buffer 6 and 7. so go to step. S 1 27. If not. go to step S 1 28 . 

Step 1 27: Down load the new row data from the frame buffer 4 to the line buffers 6,7, 
and assign the decimal value of the Row Ratio RR to the New Row Ratio NRR, that is. 
NRR=RR&pX7FF, and go to step SI 29. 

Step 1 28: Assign the Row Ratio RR to the New Row Ratio NRR, that is, NRR=RR and 
go to step SI 29. 

Step S129: Compute the Vertical Segment VS. that is. VS=(RR&0X7FF)>>6. 
Step S130: Compute the current pixel CP. That is, look for the Interpolation Value IV 
in the selected interpolation function table according to the Vertical Segment value VS 
defined' by step SI 29. Compute the gray level of the current pixel CP according to formula 
(3) and pass the CP to the horizontal interpolation controUer 14 and/or the dot buffer 18 as 
illustrated in HG. 1 . After the entire row has been processed, go to step S124. 
CP = (UP*IV + DP*-IV)»8 (3). 
Wherein " ~IV" refers to the complementary value of "IV". "»8" means right- 
shifting 8 bits; It is because the value oflV is an 8-bits data of a floating point value. 

Refer to FIG. 5 and FIG. 6 for illustrating the operations of the hoj-izontal interpolation 
conuoller 14 of the present invention. As illustrated in FIG. 5, the horizontal interpolation 
controller 14 reads the Current Pixel CP from the vertical interpolation controller 12 and Last 
Pixel LP from dot buffer 18 each time. In addition to sending the pixels to the horizontal 
interpolation kernel SI 43, the horizontal interpolation controller 14 computes the absolute 
gray difference X between the CP and LP according to formula (4) in S 1 4 1 and sends the X to 
the function selecting procedure S 1 42, 
X=Abs(LP-CP) 

The function selecting procedure S 1 42 determines which interpolation function table is 



V to be s lected according to X for the new pixels to be interpolated. The determination 

procedur is the same as that of vertical interpolation controller 12. So. please refer to the 
descriptions about the vertical interpolation controller 12 described above. The detailed 
operations for the function selecting procedure SI 42 will be omitted. 
S FIG. 6 shows the operations of the horizontal interpolation kernel SI 43. As illustrated 

in FIG. 6, the parameters required by the horizontal interpolation kernel Si 43 are New 
Column Ratio NCR, Horizontal Scaling Factor HSF, Current Pixel and Last Pixel. The 
initial value of NCR is set as 0. The HSF is determined according to the liiput Width IW of 
the original image and the Display Width DW, and adjusted as 16 bits data according to the 
10 formula (5). 

HSF = (IW«11/DW) (5), 
wherein, means left-shifting 1 1 bits of the IW. The purpose of left-shifting IW is 
to enlarge the VSF for the convenience of computation. The number of lejRt-shifted bits is 
not limited to 1 1 . It all depends on the design of the entire circuitry. The computation of 
1 5 HSF is basical ly the same as that of VSF. 

Refer to FIG. 6 for showing the operations of the horizontal interpolation kernel S 143, 
Step S 1 44: Compute Column Ratio CR, that is, CR=HSF+NCR. 

Step SI 45: Compute the MSB of Column Ratio, that is, MC=(CR&0X18O0)»H. 
The number of right^shifted bits is the same as that of the left-shifted bits of the HSF. 
20 Step SI 46: Compare if MC is larger or equal to 1, If it is larger or equal to 1. it 

indicates that the new pixel to be interpolated exceed the margin of the current pixel CP, so go 
to step S 1 47. If MC is less than 1 , then go to step S 1 48. 

Step 147: Read next pixel and assign the decimal value of the Column Ratio CR to the 
New Row Ratio NRR, that is. NRR=RR&0X7FF. 
23 StepS148: NRR= RR. 

Step S 1 49: Compute the horizontal segment HS, that is,4iS=(CR&0X7FF)»6. 
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Step S I SO: Compute the output pixel OP. . That is, look for the Interpolation Value IV 
-from the selected interpolation function table according to the Horizontal Segment HS defined 
by step S 1 49. Compute the Output Pixel OP according to formula (6) and send the OP to the 
display device 20 (as illustrated in FIG. 1 ), and then go to step S 1 44. 
5 OP=^(LP*rV + CP*--IV)»8 (6), 

i^erein " -rV" refers to the complementary value of "tV". "»8" ineans right-shifting 
8 bits. It is because the value of IV is an 8-bit data of a floating point value. 

Refer to FIG. 8 and FIG. 9 for showing the interpolation procedures of the present 
invention. As illustrated in FIG. 8, the interpolation procedure is done row by row and from 
10 left to right The sequence of interpolation is very similar to the ^canning sequence for a 
horizontal scanning and vertical scanning of a display device. As illustrated in FIG. 9, the 
steps of the interpolation procedure for each image frame are described below: 
Step S200: Start 

Step S202: Write the 0* row of the original image data from buffer 4 into the line 
IS buffers. 6 and 7, and initiate the initial data of the vertical interpolation controller 12, that is, 
set the value of NRR, Vertical Pointer VP, and Vertical Out Pointer VOP, as 0. 

Step S204: Initialize the initial value of the horizontal interpolation controller 1 4, thai is, 
set the flag (Ready), the NCR, and the Horizontal Pointer HP as 0, and then increase the 
Vertical Output Pointer by 1. 
20 Step S206: Check the value of MR. If it is larger or equal to 1 , then go to step S208. 

If not, go to step S21 0. 

Step S208: Load new line data. Add MR to VP. That is, VP=VP+MR. Then, load 
the VP and VP-1 row image data from the frame buffer 4 into the line buffers 6,7 respectively, 
and go to step S2 10. ^ 
25 Step S210: Load the new pixels and set the flag Ready as 0. Add MC to HP. That is. 

HP=HP+MC. Let Last Pixel LP equal to Current Pixel CP, LP = CP. And read the pixels 

M 



pointed by the HP from the line buffers 6, 7 as the Up Pixel UP and Down Pixel DP. 

St p S2I2: Compute the Current Pixel CP by the vertical interpolation procedure 
according to Up Pixel UP and Down Pixel DP. If the HP is 0, then LP = CP. ^ 

Step S2 1 4: If HP is larger than Input Width I W, then go to step 204. If not, go to step 

5 S216. 

Step iS2 1 6: S« the value of flag Ready as I . 

Step S220: If the flag Ready is I, then go to step SI S2. 

Step SI S2: Compute the Ou^ut Pixel OP by horizontal interpolation procedure based 
on LP and CP. 

10 Step S224: If die VOP is larger dian DH, then go to step S228. If not, go to step S220. 

Step S228: stop. 

The interpolation procedure as described above is performed in one-dimension. That 
is, first using the vertical interpolation procedure to interpolate new pixels in each <:oIunm. . 
Then, using the horizontal interpolation procedure to interpolate Output Pixels based oil the 

15 new pixels .of each colunm. In addition to one-dimensional interpolation, the interpolation ^ 
procedures can also be performed in two-dimensional manner to directly compute the Output 
Pixels. The two-dimensional interpolation procedure is explained as foUows., 

Refer to FIG. 10, it shows the system diagram of the digital image scaling device with 
autoxnatic image quality adjustment according to another embodiment of the present invention 

20 which performs two-dimensional interpolation. The digital image scaling device comprises 
a frame buffer 4 for storing image frames; a memory write controller 2 for controlling the data 
access of the original image data in the ftame buffer 4; line buffers 6,7; an access controller 8 
for reading data from the frame buffer 4 and storing into line buffers ^,7; a two-dimensional 
interpolation controller 15; a read/write controller 10 of the line buffers 6,7; and ah 

25 interpolation function look-up table 16. Moreover, the output of the two-dimensional 
interpolation controller 15 of the digital image scaling device is connected to the display 
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* device 20. vL 
The embodiment is generally the same as that of the first embodiment The difference 
is that the vertical interpolation controller 1 2 and the horizontal interpolation controller 14 are 
replaced by a two-dimensional interpolation controller 15. Thus, in the following we will 
S oiiiy focus on the two-dimensional interpolation controller 1 S for illustrating the spirit of the 
second embodiment. 

Refer to FIG. 11, it shows a functional block diagram of the two-dimensional 
interpolation controller 15. As illustrated in FIG. 11. the two-dimensional interpolation 
controller 1 5 reads two Up Pixels UPl and UP2, and two Down Pixels DPI and DP2 from the 
10 line buffers 6,7 each time. In addition to sending the pixels to the two-dimensional 
interpolation kernel SI 53, it also computes the largest absolute gray difference Z between the 
UPl, UP2, DPI and DP2 and sends Z to the function selecting procedure SI 52. The 
difference between the gray level can be computed as: . ^ ' 

Vall=abs(UPl-UP2) 
15 Vall=abs(UP2-DP2) 
Vall=abs(DP2.DPl) 
Vall=abs(DPl-UPl) 
Z=Max[Vall .Val2,Val3,Val41 
The function selecting procedure SI 52 selects a proper interpolation function table 
20 according to the value of Z. The operations of the function selecting procedure S 152 are the 
same as that of the first embodiment. So^ the details is omitted. 

Refer to FIG. 12 for showing the functional block diagram of the two-dimensional 
interpolation kernel SI 53. As illustrated in FIG. 12, the two-dimensional interpolation 
kernel S I 53 includes a vertical segment value computation block at upper part of the drav/ing 
25 and a horizontal segment value computation block at lower part of the drawing. The vertical 
segment value VSF computation block refers to the vertical segment value of the newly 
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computed interpolation pixels while the horizontal segment value HSV computation block 
refers to the horizontal section value of the newly computed interpolation pixels. The 
computation of the horizontal section and the vertical section are the same as that of the 
vertical interpolation kernel 12 and horizontal interpolation kernel 14 of the first embodiment, 
S so refer to the description above for the details. 

The major difference between the two-dimensional interpolation kernel SI 53 and the 
one-dimensional interpolation kernel is in the computation for the Output Pixels. The 
interpolation performed by the vertical interpolation kernel and the horizontal interpolation 
kernel as illustrated in FIG. 1 are computed by reference to the pixels of the same row or of 
10. the same column. In contrast, the interpolation performed by the two-dimensional 
interpolation kernel SI 53 is computed by reference to the four neighboring pixels surrounding 
the newly interpolated pixel. For this reason, it is called as two-dimensional interpolation. 
The Output Pixel OP computed by the two-dimensional interpolation kernel SI 53 can be 
computed by following formula. 
15 UTP = {UP1*F(HSV) 4-UP2*^ F(HSV)} » 8, . 

DTP = {DPI *F(HS V) +DP2*-- F(HSV)} » 8, 
OP = {UTP*F(VSV) +DTP*^ F(VSV)} » 8, 
wherein, UPl, UP2, DPI and DP2 representing the upper left side and upper right side, 
lower left side and lower right side of the Output Pixel. 
20 The two-dimensional interpolation procedure is similar to that as illustrated in FIG. 9. 

The difference between the one-dimensional interpolation procedure and the two-dimensional 
interpolation procedure is in the computation for the Output Point. The detailed description 
is omitted. 

The digital image scaling device with automatic image quality adjustment includes a 
25 plurality of interpolation ftinction tables. A function selecting procedure automatically 
selects a set of interpolation functions for interpolation, thereby to improve the blurring or 
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block affects of the iiiuges to improve the image q 

The digital image scaling device with automatic image quality adjustment has been 
described in detail hereinabove. It is to be understood that he scope of the invention also 
comprehends embodiments different from the one described/ yet within the scope of the 
S claims. For example^ the interpolation function look*up table 16 as provided in the preferred 
embodiment is divided into 32 segriients each segment being correspondent to an 8-bit data of 
a floating point value. However, it could also be divided into 64 segments each 
correspondent to a 10-bit data of a floating point value. 

It should be understood that various altematives to the structures described herein may 
10 be employed in practicing the present invention. It is intended that the fbUowing claims 
define the invention and that the structure within the scope of these claims and their 
equivalents be covered thereby. 
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1 , A digital image scaling device with automatic image quality adjustment for converting a 
resolution of original digital image into a different resolution, and converting a frame 
rate of said original digital image. into a different frame rate, said digital image scaling 
device comprising: 

m^ory buffer for temporally storing frame data of said original digital image; 

memory access controller for controlling data access of said memory buffer; 

a plurality of interpolation functions for providing various interpolation effects; 

a interpolationcontroUer for interpolating new pixels, said interpolationcontroUer 
reading a plurality of pixels from said memory buffer as referential pixels, selecting one 
interpolationfiinction as selected interpolation function from said plurality of interpolation 
functions based on gray level of said referential pixels by a function selecting procedure, and 
computing said new pixels according to said selected interpolation function. 

2. The digital image scaling device with automatic image quality adjustment as claimed in 

16 



claim 1 , further comprising: 

a plurality of line buffers for storing line data and being the buffer between said 
memory buffer and said interpolation controller; and 

a read/write controller for controlling data access of said plurality of line buffers 

3. The digital image scaling device with automatic image quality adjustment as claimed in 
claim I, wherein said int^olation controller comprises a vertical interpolation 
controller and a horizontal interpolationcontroUer: 

4. The digital image scaling device with automatic image quality adjustment as claimed in 
claim 3 . vsdierein said vertical interpolation controller loads two pixels from neighboring 
two rows of said original digital image as said referential pixels, and generates a 
interpolationpixel each time. 

5. The digital image scaling device with automatic image quality adjustment as claimed in 
claim 4, wherein said horizontal interpolation controller loads two pixels from the 
neighboring interpolation pixels generated from said vertical interpolation controller as 
referential pixels, and generates said new pixel each time. 

6. The digital iniage scaling device with automatic image quality adjustment as claimed in 
claim 1, wherein said interpolation controller is a twordimensional interpolation 
controller. 

7. The digital image scaling device with automatic image quality adjustment as claimed in 

■ . ' "* - ■ 

claim 6, wherein said two-dimensional interpolation controller loads four pixels from 

said neighboring rows of said original digital image as said referential pixels, and 

generates said new pixel each time. 

8. The digital image scaling device with automatic image quality adjustment as claimed in 
claim 1, wherein said plurality sets of interpolation function comprise a sharp function, 

^ a medium function, and a soft function. 

9. The digital image scaling device with automatic image quality adjustment as claimed in 



claim 8, wherein said plurality of interpolation functions each esublishes a look-up 
table. 

1 0. The digital image scaling device with automatic image quality adjustment as claimed in 
claim 8. wherein said function selecting procedure comprises the steps of: 

if the difference of gray level between said referential pixels is larger than a High 
Threshold, selecting said sharp function; 

else if said difference is smaller than said High Threshold and larger than a Low 
Threshold, selecting said medium function; 

else selecting said soft function. 

11. A digital image scaling method with automatic image quality adjustment for converting 
resolution and frame rate of original digital iihage into different resolution and frame 
rate, comprising the steps of: 

storing frame data of said original digital image into a memory buffer; 

reading a plurality of referential pixels from said memory buffer; 

computing the difference of gray level between said plurality of referential pixels; 

seiectingan interpolation function as a selected interpolation function from a plurality 
of interpolation functions by a function selecting procedure according to said difference ; and 

computing new pixel according to said plurality of referential pixels arid said selected 
interpdlationfiinction. 

12. The digital image scaling method with automatic image quality adjustment as claimed 
in claim 11, wherein said plurality of interpolationfunctions comprise a sharp function, 
a medium function, and a soft function. 

13. The digital image scaling method with automatic image quality adjustment as claimed 
in claim 12, wherein said function selecting procedure comprises the steps of: 

if said difference is larger than a High Threshold, selecting said sharp function; 
else if said difference is smaller than said High Threshold and larger than a Low 
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Threshold, selecting said medium function; 
else selecting said soft function. 



; 

19 



MSOOCID: <GB 235S377A_I_> 




c 
c 



Office 



Of 




Application No: 
Claims searched: 



GB 9924040.0 
All 



INVESTOR IN PEOPLE 



Examiner: 
Date of search: 



Joe McCann 
11 October 2000 



Patents Act 1977 

Search Report under Section 17 

Databases searched: 



UK Patent Office collections, including GB, EP, WO & US patent specifications, in: 
UK CI (Ed.R): H4T(TCGK); H4F(FESK, FGXE) 
IntCl(Ed.7): G06T(3/40) 
Other: Online: WPI. EPODOC, JAPIO ., 



Documents aumdered to be relevant: 



Categoiy 


Identity of document and relevant passage 


Relevant 
to claims 


X 


EP 08I4429A2 


(Quantel) - see abstract 


1.11 


X 


EP 0789325 A2 


(Adobe Systems) - see abstract 


1,11 


X 


WO 96/16380A1 


(Minesota Mining & Mfg) - see abstract 


1,11 


X 


WO 90/16034A1 


(Eastman Kodak) - see abstract 


1,11 


X 


US 5832142 


(Fuji Photo Film) - see abstract 


1,11 


X 


US 5054100 


(Eastman Kodak) - see abstract 


1,11 



X DocumcmiiKJicalingladcofiiovchyormvenUveslqi 
Y Pocummt tp<1ica*wg *ack of inventive step if combirod whh 
one cr more ottxer doctaments of same category . 

& Mento of die gaipe patent ftmily 



A Document indicating technological bade^ound and/or state of the art. 
P l>icimiem published on or after the dedaf«d priority date but before the 

filing date of this invention. 
E Patent document published on or after, but with priority date earlier than, 

the filing date of this application- 



NSOOCIO: <G8_2355377A_I_> 



An Executive Agency of the Deparnnent of Trade and Industry 



r 



